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Abstract 

Wc construct a Supersymmctric (SUSY) Grand Unified Theory (GUT) of Flavour 
based on 5*4 x S'f/(5), togetlier witli an additional (global or local) Abelian sym- 
metry, and study it to next-to-leading order (NLO) accuracy. The model includes 
a successful description of quark and lepton masses and mixing angles at leading 
order (LO) incorporating the Gatto-Sartori-Tonin (GST) relation and the Georgi- 
Jarlskog (GJ) relations. Wc study the vacuum alignment arising from F-terms to 
NLO and such corrections are shown to have a negligible effect on the results for 
fermion masses and mixings achieved at LO. Tri-bimaximal (TB) mixing in the 
neutrino sector is predicted very accurately up to NLO corrections of order 0.1%. 
Including charged lepton mixing corrections implies small deviations from TB mix- 
ing described by a precise sum rule, accurately maximal atmospheric mixing and a 
reactor mixing angle close to three degrees. 
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1 Introduction 



A long standing quest of theories of particle physics beyond the Standard Model (SM) is 
to formulate a theory of quark and charged lepton masses and quark mixings. In recent 
years, this quest has been extended to include the neutrino masses and lepton mixing as a 
result of tremendous experimental advances and discoveries in neutrino physics. Indeed, 
perhaps the greatest advance in particle physics over the past dozen years has been the 
measurement of neutrino masses and mixing involving two large mixing angles associated 
with atmospheric and solar neutrino oscillation experiments, while the remaining mixing 
angle, although unmeasured, is constrained by reactor neutrino oscillation experiments to 
be relatively small. The empirical observation of TB lepton mixing [l] contrasts sharply 
with the smallness of quark mixing, and this observation, together with the smallness of 
neutrino masses, provides new and tantalising clues in the search for the origin of quark 
and lepton flavour in terms of a theory of flavour that would supersede the SM. 

TB lepton mixing in particular hints at a spontaneously broken family symmetry Gf 
which might underpin a flavour theory of all quarks and leptons, but which might only 
reveal itself in the neutrino sector. What is the nature of such a family symmetry? In the 
(diagonal) charged lepton mass basis, it has been shown that the neutrino mass matrix 
leading to TB mixing is invariant under (off-diagonal) transformations S and U which 
constitute the Klein group [2)|^ The observed neutrino flavour symmetry corresponding to 
the two generators 5* and U of the Klein group may arise either directly or indirectly from 
certain classes of discrete groups |3]. Several models have been constructed that account 
for the structure of leptonic mixings, e.g. (4]-|8], while other models extend the underlying 
family symmetry to provide a description of the complete fermionic structure [9 27 ,^ 



If the neutrino flavour symmetry arises directly from the family symmetry [3] then this 
implies that the family symmetry should contain the generators S and U so that they 
can be preserved in the neutrino sector at LO. The smallest group that contains the 
generators S and U together with a (diagonal) phase matrix T is 5*4 [2] and the models 
found in |7l[T5)|T6||20)|2l] are based on 5*4. The fact that it is possible to construct direct 
models based on the family symmetry A4 (generated by S and T only) is owed to the 
required absence of family symmetry breaking fields (flavons) in the representations 1' 
and 1" of A4. In such ^4 models the symmetry associated with the generator U arises 
accidentally at LO [g]. 

Despite the plethora of models, there are surprisingly few which successfully combine a 
discrete family symmetry containing triplet representations (necessary to account for TB 
mixing) together with a GUT. Examples are the A4 x SU{5) model s [Tt] , the T' x SU{5) 
model m, the x SO{10) models p], the ^4 x SO{10) models mT7the PSL{2,7) x 



5*0(10) model 22 , and the A27 x S'O(IO) models [25j. The possible combination 5*4 x 
SU (5) stands out in the sense that it combines the minimal GUT with the minimal choice 
of family symmetry, which contains the generators 5* and U. 

In this paper we construct a SUSY GUT of Flavour based on S4 x SU{5) in which the 



^In a different basis S and U could as well be represented by diagonal matrices. 
^See 28 for review papers with more extensive references. 
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5 matter fields of SU{5) are assigned to a triplet of 5*4, while the 10 matter fields are in 
a doublet plus a (trivial) singlet of 5*4. The operators are also controlled by an additional 
U{1) symmetry which segregates different types of flavons into different (charge) sectors 
at LO, e.g. flavons, whose vacuum expectation values (VEVs) preserve the generators 
S and U, only couple to neutrinos at LO. Furthermore, the U{1) symmetry controls the 
amount of flavon contamination between different sectors beyond LO. We shall show that 
the model predicts TB neutrino mixing very accurately up to corrections of order 0.1% at 
the GUT scale. In order to do so, we specify the complete effective theory, valid just below 
the GUT scale, and perform a full operator analysis of all relevant terms including several 
flavons. Furthermore, we make an exhaustive study of vacuum alignment to NLO arising 
from the F-terms of driving flelds. These flelds are, similar to the flavons, gauge singlets 
which only transform non-trivially under 5*4 x U{1). The model leads to a successful 
description of quark and charged lepton masses and quark mixing angles, including the 
GST relation between down and strange quark masses and the Cabibbo angle 6*^2 (29] , and 
the GJ relations between charged lepton and down quark masses |30], with bottom-tau 
Yukawa uniflcation. The GJ factor is also responsible for the (left-handed) charged lepton 
mixing angle being ~ ^i2/3- Including corrections due to non-zero mixing in the 
charged lepton sector induces deviations from TB lepton mixing expressed in a lepton 
mixing sum rule [31j with a reactor mixing ang le of order 9lJ{3V2). Since Of^ ^ and 
~ 0, maximal atmospheric mixing holds to good precision at the GUT scale. We note 
that in the realisation of the model we discuss in detail, small and moderate values of 
tan P, the ratio of the VEVs of the two electroweak Higgs doublets present in the Minimal 
Supersymmetric Standard Model (MSSM), are preferred because the hierarchy among the 
top and the bottom quark mass is accounted for by the family symmetry. Since our main 
concern in this work is the explanation of fermion masses and mixings, we leave aside the 
problem of constructing a GUT Higgs (super-)potential ensuring the correct breaking of 
the gauge group SU (5) to the SM. 



We remark that an S4 x SU{5) model has also been proposed in 20 , in which, how- 
ever, NLO corrections as well as the vacuum alignment of the flavons are not studied in 
detail. By contrast in the different 5*4 x SU (5) model proposed here the LO predictions 
are robust against the NLO corrections which are explicitly calculated and shown to be 
small. Furthermore, the alignment of the flavon VEVs is a natural result of the flavon 
superpotential. The latter is thoroughly investigated to NLO. 

The layout of the remainder of the paper is as follows: in section 2 we deflne the 
SUSY 5*4 X SU{5) model for a general class of U{1) charges and discuss the results for 
fermion masses and mixings at LO. In section 3 we perform an operator analysis of all 
relevant terms including several flavon flelds. In this context, we introduce the notion of 
desired, dangerous, marginal and irrelevant operators. We flnd 26 possible U{1) charge 
assignments which neither lead to dangerous nor to marginal operators. Section 4 contains 
a study of the vacuum alignment which justifles the alignments assumed in previous 
sections. On the basis of the results of the analysis of higher-order terms disturbing this 
alignment and of the possibility to correlate the VEVs of different flavons we choose the 
actual U{1) charges. In section 5 we discuss the NLO corrections to Yukawa couplings 
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and to the flavon superpotential for a particular choice of U{1) charges and show that 
all corrections induced to fermion masses and mixings are small. Section 6 concludes 
the paper. The first three appendices contain the group theory of 5*4, an example of 
messengers generating the operators giving rise to the GJ and the GST relations, and 
the list of dangerous and marginal operators with less than four flavons contributing 
to the fermion mass matrices, according to the classification introduced in section 3. 
Appendix D is dedicated to a discussion of how to ensure that the family symmetry is 
broken in the SUSY limit and how to (further) reduce the number of free parameters 
among the flavon VEVs introducing additional driving fields and using couplings with 
positive mass dimension. 



2 The ^4 X SU(5) model and LO results 

In this section we present the model and discuss the LO result for fermion masses and 
mixings. In table [T] we show the superfield charge assignments of our SUSY GUT of 
Flavour based on 5*4 x SU{5). For convenience the group theory of 5*4 is summarised in 
appendix A. The 5 matter fields F of SU{5) are assigned to a triplet of 5*4, while the 
ten-dimensional matter fields are assigned to a doublet T plus the trivial singlet T3 of S4. 
The right-handed neutrinos are taken to be a triplet of S4, analogous to the A4 see-saw 
models in [6], however there are some differences in the neutrino sector, as discussed below. 
The GUT Higgs fields ifg, and are all singlets under the family symmetry 5*41^ We 
note that these Higgs representations each contain a Higgs doublet. The MSSM Higgs 
doublets Hu and Hd then originate from, respectively, ifg and one linear combination 
of the doublets in and H^. |^ The component within Hd is responsible for the 



GJ relations between charged lepton and down quark masses 30 . Concerning the other 
(orthogonal) linear combination we assume that it decouples from the low-energy theory 
by acquiring a GUT scale mass just as the colour triplets, contained in the GUT Higgs 



fields, and other non-MSSM states 33 . The (light) MSSM Higgs doublets Hu,d acquire 
VEVs Vu,d with tan (3 = Vu/vd- 

In addition, we introduce a number of flavon fields An important feature of the 
model is that different fiavons couple to different sectors of the theory at LO. The fiavons 
^■^p are labelled both by the representation p of 6*4 under which they transform (1, 2, 3, 3') 
and by the fermion sector / to which they couple at LO, namely u, d and where d e 



''The SU (5) symmetry might be broken by an additional 24 Higgs field which can be rendered irrelevant 
for the Yukawa operators by suitable charges under the U{1) symmetry. The 45 Higgs field which should 
be added due to anomaly cancellation may similarly decouple from the up quark sector. Therefore we 
disregard these Higgs fields in the following. Since the actual construction of a GUT Higgs (super- 
)potential is beyond the scope of this work, we do not specify further flavon fields which might be 
necessary in order to allow relevant couplings in this (super-)potential, which were otherwise forbidden 
by the U{1) symmetry. An alternative possibility to achieve the breaking of the GUT symmetry might 
arise from appropriately chosen boundary conditions in an extra-dimensional scenario, see [32| . In this 
case also the problem related to the splitting of doublets and colour triplets is elegantly solved. 

^ Again, it might be necessary to invoke the presence of further fiavons to generate S'4 x [/(I) invariant 
couplings between iJg and in order to introduce mixing among their Higgs doublet components. 
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Table 1: The symmetries and charges of the superfields in the SU{5) x 6*4 x f/(l) model. 
The f/(l) assignment depends on three integers x, y and z. 

up to the difference in the GJ factor. Thus, for example, at LO, the flavon doublet $2 
appears only with TT, the flavon triplet $3 appears only with FT3, while the neutrino 
flavons only appear with NN. Notice that $^ consist of singlet, doublet and (primed) 
triplet representations with vacuum alignments which preserve the generators S and U 
contained in S4 leading to TB neutrino mixing. 

The segregation of the different flavons, coupling to distinct sectors, at the LO level 
is achieved through an additional U{1) symmetry. For the time being, we assume this 
symmetry to be global in order to avoid constraints coming from the requirement of 
anomaly cancellation. The U{1) charges of the fields are expressed in terms of three 
integers x, y and z, as shown in table [l} Note that the Higgs fields and are taken 
to be neutral under this symmetry. 

The family symmetry 5*4 is only broken spontaneously by flavon VEVs in our model. 
On the other hand, the spontaneous breakdown of the global U{1) symmetry leads to the 
appearance of a (very light) Goldstone boson unless the U{1) is also explicitly broken. For 
this reason we assume a scenario in which the U{1) symmetry is explicitly broken in the 
hidden sector of the theory which is also responsible for SUSY breaking, so that the soft 
terms do not respect the U{1) symmetry. Then the would-be Goldstone boson will have a 
mass of the order of the soft SUSY mass scale of around 1 TeVj^ Alternatively one could 
gauge the U{1) symmetry and add further particles in order to cancel the anomalies. As 
the set of these additional particles would depend on the explicit U{1) charge assignments, 
we do not follow this approach. 

In our study, we disregard possible corrections to fermion masses and mixings which 
are due to deviations from the canonical normalisation of the Kahler potential. Such 
deviations arise in general, if subleading corrections involving (several) flavons are taken 
into account. Studies of the possible effects of non-canonically normalised kinetic terms 
on fermion masses and mixings can be found in, e.g., |34] . 

The lowest dimensional Yukawa operators invariant under the family symmetry 5*4 x 

^We remark that in this context it would be interesting to investigate whether the family symmetry 5*4 
alone is sufficient to constrain the soft mass terms of sfcrmions in such a way that all bounds associated 
with flavour changing neutral current and lepton flavour violating processes can be satisfied without 
tuning the soft mass parameters. 
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T^T^H^ + —TT^'^H^ + —TT^^^^H^ . (2.1) 



f/(l), contributing to the up quark mass matrix, are (we omit order one coefficients in 
the following) 

By M we denote a generic messenger scale which is common for all higher-dimensional 
operators we discuss. It is expected to be around the GUT scale. If not explicitly stated, 
we take into account all possible independent 5*4 contractions for each operator so that 
frequently one given operator entails - depending on the vacuum alignment of the fiavons 
- a certain number of different contributions to the fermion mass matrices. 

The LO operators giving rise to masses for charged leptons and down quarks read 

^FT3$^ff5 + ^(F$^)i(T$^)i^f45 + ^(F$^$^)3(T$^)3i^5 , (2.2) 

where (■ ■ ■ )i ^^'^ (' ' ' )3 denote the contraction to an S4 invariant 1 and to the triplet 3, 
respectively. Note that there are other possible operator contractions involving the same 
fields that we do not write down. As a first step towards achieving the GJ and GST 
relations we have assumed that the two contractions shown in Eq. (2.2) are the dominant 
ones among the various possible ones, existing in a generic effective theory with a cutoff 
scale M. One example of messengers which only give rise to these contractions is discussed 
in detail in appendix B and shown diagrammatically in figure [T] The operator involving 
the Higgs field must have the appropriate form, 

^(Fi$^,i + F,^, + F3$^,2)(Ti$^,2 + T2^ii)HjE , (2.3) 

to give rise to the GJ relations, 771^ = Snif. and = rrif^/S and mf, = m,-, after insertion 
of the fiavon VEVs. The third operator in Eq. (2.2) leads to 

Xi 



+ ^[(^2(*l2)'+ Fs{<!>i,Y)mi, + T2^,) + {Fs{^i2r+ F,{^i,f)mi, + t2^,) 



M3 

X2_ 
M3 



+ iF,i¥,^,f+ F2i^i,f)iT,^i, + T2^i,m , (2.4) 

where the two coupling constants xi and X2 indicate two independent invariants. With 
an appropriate vacuum alignment of the fiavon VEVs, Eq. (2.4) gives rise to equal (12) 
and (21) entries in the mass matrices necessary to achieve the GST relation. 
In the neutrino sector the leading terms are 

VdFNH^ + aNN^'i + /3A^A^<I>^ + 7A^A^<I>^, . (2.5) 

Using the vacuum alignment 

m) = ^2 (J) and ($^) = (^^ , (2.6) 
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Figure 1: The Feynman diagram on the left shows how the contribution 
(T$2)i (-^"^3)1-^^45/^^ "^^^ arise in the context of a high energy completion. On 
the right we show the relevant diagram for generating the effective operator 
(T$3)3(F$2'^2)3-^5/^^- these diagrams scalars/fermions are displayed by dotted/solid 
lines. Crosses indicate a VEV for scalar components and mass insertions for fermions. 
See appendix B for details. 



for the two flavons in doublet representations coupling to up quarks we see that the up 
quark mass matrix is diagonal 

/^^^^/M2 0\ 
Mu^ \ ^^/M 0] vu. (2.7) 

V 01; 

Taking 

^^/M ^ and Ip^/M ^ , (2.8) 

with A ~ 0.22 being the Wolfenstein parameter [35], we obtain the well-known mass 
hierarchy among the up quarks 

ruu : rric : mt ^ : : 1 . (2.9) 
Similarly, we see using the alignment 

($3) = Q , (^3) = ^3 , (*2) = (J) , (2.10) 

that the down quark, Md, and charged lepton mass matrix, Mg, are at LO of the form 
(in the convention in which left-handed fields are on the left-hand side and right-handed 
fields on the right-hand side of the mass matrix) 

Md ^ -{^if^i/M^ ^i^i/M^ -^i^i/M^ + {^if^t/M^ \ , (2.11) 

\ ifi/M 

and 

~{^if^i/M^ 

Me « I {'^if^i/M'^ -3ipi^i/M^ \vd. (2.12) 
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Vd denotes the VEV of the electroweak Higgs field which is in general a linear combi- 
nation of the doublet components of the GUT Higgs fields H-^ and H^. Assuming that 
the angle associated with this mixing is of order one we can absorb the corresponding 
order one factors into the other (not displayed) order one coefficients of each operator. 
For 

ifl/M ^ X'+' , ifi/M ^ X'+' , yp^/M ^ A , (2.13) 
with A; = or A; = 1, we find for the down quark and charged lepton mass hierarchy 

nid ■ tris : rrih ^ A"^ : A^ : 1 , (2-14) 
me : : ^ (1/3) A^ : 3 A^ : 1 , (2.15) 

and for the mixing angles 9fj and of the left-handed fields 

9f,^ X, 9',,^X\ 9i,^X\ (2.16) 
^(1/3) A, ^^^3^0, ^^3^0. (2.17) 

The mass of the third generation of charged leptons and down quarks is at LO given by 

mi,^mr^ X^+^Vd. (2.18) 

As a consequence, the two possible choices of k are equivalent to two different types 
of models: for = we have m;, m,- 40/ tan/3GeV so that the value of tan/3 
is expected to be larger than 30, while for k = 1 smaller values of tan (3 in the range 



5 < tan/3 < 15 are preferred. Since the up quark mass matrix is diagonal, see Eq. (2.7) 



the Cabibbo angle has to be generated in the down quark sector, as one can see from 



Eq. (2.16). Also the two other quark mixing angles ^'^323 ~ ^'^323 turn out to be of 



the correct order of magnitude. Furtherm ore, the model incorporates the GST relation 



^12 ~ ^12 ~ \/^d/^si see Eqs. (2.14 2.16), arising from the equality of the (12) and (21) 
elements as well as the vanishing of the (11) element in the down quark mass matrix Md 
at LO. Note that we can achieve the same LO results in the down quark and charged 
lepton sector if we assume ($3) = ( 0, k, 1)* with \n\ = 1, k complex, instead of using 



($3) oc (0, —1, 1)* as shown in Eq. (2.10 ). For this reason we perform the study of marginal 
and dangerous Yukawa operators, which can be found in the next section, assuming the 
alignment ($3) oc (0, k, 1)*. However, as one can see the fiavon superpotential, discussed 
in section 4, only gives rise to the alignment ($3) oc (0, —1, 1)*. Thus, in the actual 
realisation, given in section 5, the latter alignment is used. 

Finally, we display the LO results for the neutrino sector: the neutrino Dirac mass 



matrix M^) arising from Eq. (2.5) has a very simple form 

/I 0\ 

Mb = i/z) 1 (2.19) 
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while the right-handed neutrino mass matrix 

Mr = \ Pip^2- 7^3' PV2 + '^IVl' a<^r - I'^l' I , (2.20) 
is the origin of TB mixing in this model if we use the vacuum alignment 



{%) = ^3' [ 1 I , (<^>2) = V2 (J) , (<^>l) = ^1 (2.21) 



(together with the information that these VEVs are all of the same order of magnitude). 
Applying the type I see-saw formula 

nfjf = MnM-^Mjj , (2.22) 

we find for the (complex) light neutrino masses 

Due to the three different couplings a, /3, 7 the three light neutrino masses are unrelated 
and any type of mass hierarchy can be accommodated. Especially, the former are not 
constrained by a sum rule, as it is the case in the ^4 models [6]. 

Concerning the approximate scale of the VEVs of the flavons $2 ^^'^ "^3' note 
that, since they set the scale for right-handed neutrino masses, the physical neutrino 
masses 

2 2 

mi ~ 0.1 eV ~ , (2.24) 

V^l,2,3' 

imply that, </'i2 3' ~ ^^^^ GeV, assuming y£, ~ 0.3 and tan/3 ~ 10 for example. Assuming 
the generic messenger scale M to be of the order of the GUT scale, M ^ 10^^ GeV, we 
see that (p'^ 2 3' fulfil 

^ A^M , ^ A^M , (^^, ^ A^M . (2.25) 



The neutrino mixing stemming from Eq. (2.22) is exactly TB mixing. However, it will 
be corrected by the non-trivial (12) mixing present in the charged lepton sector, see 
Eq. (2.17), so that the lepton mixing angles at the high energy scale are given by [31] , 

sin^ ^ 1/2 , sin^ ^ 1/3 + 2/9 A cos , sin ^ A/(3y2) , (2.26) 

which incorporates the usual prediction for the reactor mixing angle, associated with the 
presence of the GJ factor and the SU{5) context, leading to the prediction ^ 3° for 



A ~ 0.22, and, after eliminating A, to the sum rule relation 31 



sin^ 



^^2 ~ ^ (^1 + 2y2sin^^3Cos(5') , (2.27) 



where 5^ is the leptonic Dirac CP phase. 

The neutrino sector in the model above differs from that in the A/^ one [g] by the 
presence of the doublet fiavon $2 whose VEV structure preserves the generators S and 
U . Note that, if the (irreducible) representations of 6*4 are decomposed into those of its 
subgroup y44, we find that the doublet $2 decomposes into the two non-trivial singlets 
V and 1", see appendix A. In the model separate fiavons in representations 1' and 
1", respectively, which, if allowed to appear with independent couplings, would violate 
the symmetry associated with the generator U , have to be absent in order to achieve 
TB mixing This is why the model accidentally preserves the generator U in the 
neutrino sector, even though U is not contained in the group A4 joj. In the present model, 
both the generators S and U are contained in 5*4, and remain preserved in the neutrino 
sector at LO, so that the neutrino flavour symmetry is reproduced in a more direct way. 

The vacuum alignment of the fiavons which has been only assumed in this section 
will be discussed in more detail in section 4. We will show that the alignment (in which 
($3) oc (0, —1, 1)*) can be produced through F-terms of an additional set of gauge singlet 
fields charged under the family symmetry 5*4 x f/(l). Regarding the assumed sizes of the 
VEVs we find that these can be partly explained by the superpotential which gives rise to 
correlations among the VEVs and partly by introducing additional gauge singlets which 
allow couplings of positive mass dimension in the fiavon superpotential, whose magnitude 
can be appropriately chosen in order to reproduce the sizes of the VEVs. This issue is 
discussed in section 5.1 and appendix D. 



3 Dangerous and marginal Yukawa operators 

After presenting the LO result which incorporates the prediction of TB mixing in the 
neutrino sector and the successful accommodation of all charged fermion masses and 
quark mixings, we now discuss in more detail the role of the additional U{1) symmetry 
in forbidding all operators which would otherwise have a considerable effect on these LO 
results. For example, as already remarked, beyond the LO we expect the segregation 
of different fiavons associated with a particular quark and lepton type / = m, (i, z/ to 
break down. 

In order to identify operators which should be forbidden, we first classify them accord- 
ing to which contributions they give to the fermion mass matrices. In this analysis we 
assume for the VEVs of the fiavons to have the LO form, as shown in Eqs. ( 2.6[2.10|2.21 ) 



together with the generalised alignment of ($3). However, as we will discuss below, these 
VEVs receive in general corrections stemming from subleading terms present in the fiavon 
superpotential. We fix the actual values of the U (1) charges x, y and z on the basis of the 
results for the fiavon superpotential. For this particular choice (and the specific alignment 
($3) oc (0,-1,1)*) we discuss, in section 5, the subleading corrections induced through 
shifts in the fiavon VEVs (and subleading operators), showing that their effects on fermion 
masses and mixings are negligible. 

We can distinguish the following four types of Yukawa operators 
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desired operators: These are the operators which - by definition of the U{1) charges 
- are present at LO, see Eqs. ( |2l|2.2||2.5D . 



• dangerous operators: These operators strongly perturb the form of the mass matrices 
achieved at LO. In the case of charged fermions their contribution is larger than the 
one stemming from the desired operators. In the case of right-handed neutrinos, 
any contribution which is larger than or of the same order of magnitude in A as the 
one coming from the desired operators has to be considered as dangerous because 
TB mixing crucially depends on the form of the right-handed neutrino mass matrix 
as well as on the fact that all entries of the latter are of the same order of magnitude 
in A. 

• marginal operators: These operators give contributions to charged fermion mass 
matrices which are of the same order in A as the LO contribution. Although not 
dangerous in the above sense, their presence has a significant impact on the final 
result. For example, in the case of the GST relation it might happen that such a 
marginal operator contributes differently to the (12) and the (21) elements of the 
down quark mass matrix so that the relation between the Cabibbo angle and 
the masses of down and strange quark is lost. 

• irrelevant operators: These operators do not contribute to fermion masses or mixings 
at LO in A and thus do not need to be forbidden. For phenomenology they are 
however not completely negligible, since they (can) give rise to corrections to the 
LO result, e.g. they are responsible for deviations from exact TB mixing in the 
neutrino sector. 

According to this classification we wish to forbid all dangerous and all marginal op- 
erators. Since the entries of the mass matrices M„, Md^e, Mr, and Mr are of different 
order in A, we list the structures of the LO as well as the dangerous and the marginal 
contributions for each sector separately. Note that we constrain ourselves in this study 
to the case = 1, since it turns out that this choice reduces the number of dangerous 
and marginal operators to a certain extent and thus facilitates the search for appropriate 
f/(l) charge combinations x, y and z, especially with small absolute values. The value of 
k is thus specified to k = 1 for the rest of the paper. 



In the up quark sector, Eq. (|2.7|) tells us that the LO mass matrix has the form 

(3.1) 




so that we classify as dangerous (dang) all mass matrix entries which are equal or larger 
than 

■ A^ A^ A3 

^dang > I A3 A I . (3.2) 
A3 A . 
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Since the (33) entry of M^*-* is 0{1) any corrections to this entry are irrelevant. The sizes 
of the other diagonal entries are determined by the requirement of not having too large 
up and charm quark masses, while the bounds on the off-diagonal elements originate from 
the constraints on the quark mixing angles, 6'^2 ~ ^23 ~ -^^ Of^ ~ A^, as well as from 
achieving the correct mass hierarchy. Similarly, the operators characterised as marginal 
(marg) give rise to entries in of the order 

/ A« A^ A^ \ 

^marg ^ A^ A^ . (3.3) 

V A^ A2 . / 

Using Eqs. ( 2.11|2.12 ) we see that the LO of the entries in Md^e is 

/ A^ A^ \ 
M,^o ~ A^ A^ AM . (3.4) 

V A^ A^ A2 / 

Thus, we classify operators as dangerous and marginal which lead to the following mass 
matrix entries 

/ A^ A^ A^ \ / A^ A^ A^ \ 

Mf/s > A^ A^ AM and M^f ' ~ A^ A^ AM , (3.5) 
V A^ A3 A / ' V A^ A^ A2 / 

respectively. Note that our results are based on the assumption that the mass matrices 
are symmetric regarding the order of magnitude in A. We make this assumption although 
the off-diagonal elements in the third row and column of and M^, at LO, are non-zero 
only for one of the two matrices but not for both simultaneously. Note further that the 
(11) entry of Md^e vanishes at LO. The constraint on this entry to be smaller than A^ 
results from the requirement that the determinant of M^ e should not exceed A^^. 

In the neutrino sector, all operators involving flavons, which contribute to the neutrino 
Dirac mass matrix M^), 

'10 

M^^ ~ ( 1 I , (3.6) 
1 



can be classified as irrelevant, because the LO term, see Eq. (2.5), originates at the renor- 
malisable level, i.e. does not require the presence of any flavons. As already explained, 
since the form of the LO result of Mji is crucial to achieve TB neutrino mixing, 

/ A^ A^ A^ \ 
~ A^ A^ AM , (3.7) 
V A^ A^ A^ / 

any further contribution being of order A'' or larger is associated with a dangerous operator 

/ A^ A^ A^ \ 
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All other operators contributing at the level < are irrelevant. 

Any operator comprising two superfields of the type T3, T, F and and an arbitrary 
number of flavon fields that gives a dangerous or marginal contribution to a mass matrix 
should be forbidden by the additional U{1) symmetry. In the following, we first classify 
all operators with up to three flavons according to the categories above, because the 
LO result for fermion masses and mixings is generated by operators with at maximum 



three flavons, see Eq. (2.2). The structures of the resulting mass matrices determine 
the unwanted operators which are listed in appendix [Cj Note that in this calculation 
we assumed the vacuum alignment of the flavons as given in Eqs. ( [2^2.10|2.21D , apart 



from the fact that we allow ($3) to be aligned as (0, k, 1)* with \k\ = 1, k complex. 



instead of using (0, —1, 1)* as shown in Eq. (2.10). The reason for this slightly generalised 
alignment of ($3) lies in the fact that keeping the relative phase among the two non- 
vanishing entries of ($3) arbitrary might leave us more freedom in the construction of 
the fiavon superpotential, from which the alignment of the flavons originates. Again, we 
emphasise that using the actual realisation of the flavon (super-)potential presented in 
section 4, we arrive at the alignment ($3) oc (0, —1, 1)*. However, an analysis of the 
Yukawa operators in the slightly more general framework is still useful, because in any 
case the solutions found in this analysis can also be applied to the specific alignment of 
($3) in which k is fixed to a certain value. As we comment below, fixing k to — 1 leads 
to some more possible sets of charges x, y and z, which however do not give rise to any 
feature not already revealed in the sets found through the analysis using the generalised 
alignment of ($3). Apart from the unwanted operators the table in appendixOalso shows 
the corresponding A-suppression as well as the entries of the mass matrices which are in 
conflict with the LO setupj^ Entries for which the operator is marginal in the above sense 
are marked with square brackets, whereas in all other cases the operator is dangerous. 
The three operators denoted with a prime (43', 48', 54') differ from the LO terms of the 



down quark sector in Eq. (2.2) only by the exchange of H-^ and H^. All other terms given 
for the down quark sector must be forbidden for both Higgs fields, H-^ as well as H^. 

A complete scan over the parameters x,y,z with \x\, \y\, \z\ < 5 yields 43 different 
f/(l) symmetries which forbid all unwanted operators with up to three flavon fields. Here 
we have identified the U{1) symmetry related to (— x, —y, —z) with the one represented 
by {x,y,z). Apart from this also dangerous or marginal operators with more than three 
flavons should be forbidden. The dangerous operators are 

As marginal operators we find 



^Note that we only give one of the two entries (ij) and (ji) in the case of the symmetric or symmetrised 
terms TTH^, T^^TH^, NN. 
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# 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


X 


1 


2 


2 


2 


2 


2 


3 


4 


4 


4 


4 


5 


5 


y 


2 


1 


1 


4 


5 


5 


1 


2 


3 


5 


5 


1 


4 


z 


5 


4 


5 


5 


1 


4 


5 


5 


5 


2 


3 


4 


1 




# 


14 


15 


16 


17 


18 


19 


20 


21 


22 


23 


24 


25 


26 


X 


-1 


1 


2 


2 


2 


2 


-3 


3 


3 


4 


4 


4 


5 


y 


3 


-4 


-5 


-3 


4 


5 


4 


-2 


-2 


-5 


-1 


-1 


-2 


z 


5 


5 


4 


5 


-5 


-3 


5 


4 


5 


3 


2 


5 


4 



Table 2: The 26 viable U{1) symmetries defined by the parameters x, z |2;| < 5) 

for the alignment ($3) oc (0, k, 1)* with \hi\ = 1, k complex. Obviously, for each set of 
charges {x,y,z) also the set (— x, —y, —z) is a viable candidate. 



Obviously, these must be removed as wellj^so that we end up with 26 viable U{1) sym- 



metries listed in table |2j This set will serve as a source of a candidate U{1) symmetry 
which eventually leads to a successful x SU (5) model. 



Assuming the alignment of ($|) to be the one as given in Eq. (2.10), we find that 
two operators among those classified as dangerous or marginal become irrelevant, namely 
operators #18 and #32 in the table found in appendix [C} Allowing these two operators, 
we find 18 additional solutions for the U{1) charges x, y and z as compared to the 
43 mentioned above. Including eventually the requirement to forbid the dangerous and 
marginal operators with more than three fiavons leaves us with 15 new sets {x, y, z) that 
are added to the 26 U{1) symmetries of table [2] However, as we do not find any set 
with charges x, y and z with \y\, \z\ < 4, these 15 new solutions are qualitatively 
not different from the ones given in table |2| so that we do not consider them any further. 
Nevertheless in the subsequent sections 4 and 5 the alignment of ($3) is fixed through the 
fiavon superpotential to be proportional to (0, —1, 1)*. 

Finally, we remark that the high energy completion we proposed in order to only 
generate the operators {F^^)i{T^i)iH^/M'^ and {F^'^^i)3{T^i)3H^/M^ in the down 
quark sector actually depends on the choice of the combination x, y and z, because in the 
calculation for generic charges x, y and z we implicitly relied on the fact that all heavy 
fields appearing as messengers carry (different) charges under the U{1) symmetry so that 
only the operators given in appendix B are generated at the renormalisable level. This 
must be taken into account as an additional constraint on the solutions presented in this 
section. We will comment on this point in section 5 and appendix B. 



^We remark that the classification of these operators into dangerous and marginal does not depend 
on the relative phase introduced in the generalised alignment of ("I>f). 
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4 Vacuum alignment 



The origin of the vacuum ahgnment is an integral part of a model of fermion masses and 
mixings using a non-Abelian family symmetry]^ We first discuss in section 4.1 how to 
achieve the vacuum alignment shown in Eqs. ( |2.6[2.10|2.21 ) by introducing a new set of 



fields, called driving fields in the following, from whose F-terms we derive the alignment. 
We actually show that in this case ($3) oc (0, —1, 1)* is the only solution, so that the 
parameter k in the generalised form of the alignment of ($3), used in the preceding 
section, is fixed to k = —1. The U{1) charges of the driving fields are given in terms of 
the three parameters x, y and z which have been introduced in section 2. The additionally 
allowed operators of the flavon superpotential beyond those given in section 4.1 are then 
determined for all 26 sets of f/(l) charges x, y and z shown in table 2. On the basis of this 
study we exclude all sets (x, y, z) for which these additional operators strongly perturb 
the LO vacuum alignment. Focusing on the remaining four choices of U{1) charges x, y 
and z for which no such operators arise if the LO results of the flavon VEVs are used, 
we search for possibilities to (partly) correlate the flavon VEVs by introducing further 
driving fields. We eventually fully specify the values of the U{1) charges x, y and z by 
choosing the possibility which allows for the largest number of correlations among the 
scales of the various flavon VEVs. This is explained in section 4.3 and in detail shown 
in appendix D. Furthermore, we discuss in section 5.1 and appendix D that a minimum 
of undetermined parameters among the flavon VEVs can be reached, if driving fields are 
included which allow for couplings with positive mass dimension. 

4.1 Flavon superpotential at LO 

In our approach we generate the vacuum alignment through F-terms by coupling the 
flavons to driving fields. The latter are - similar to the flavons - gauge singlets and 
transform in general in a non-trivial way under 5*4 x f/(l). We introduce furthermore a 
U{1)r symmetry under which all driving fields carry charge +2. In contrast to this, flavons 
and the GUT Higgs fields are uncharged under U{1)r and supermultiplets containing SM 
fields (or right-handed neutrinos) have U{1) r charge +1. In this way, the driving fields can 
only appear linearly in the superpotential and in addition do not have direct interactions 
with SM fermions (and right-handed neutrinos). Under the assumption that the family 
symmetry 6*4 x U{1) is broken at high energies, a scale at which SUSY is not broken in 
the visible sector, we can deduce the alignment of the flavon VEVs from the equations 
arising from setting the F-terms of the driving fields to zero. Table [3] gives a list of driving 
fields with which we generate the vacuum alignment in Eqs. ( [2^.10[2.2lD . The f/(l) 



charges are expressed in terms of the parameters x, y and z so as to allow the relevant 
superpotential operators which give rise to the desired alignments. In the following we will 
discuss these terms in turn. Most of the alignments are achieved through renormalisable 
operators with three fields in order not to introduce further mass scales. In the case of 



^There are also other possibilities to break a family symmetry, e.g. through non-trivial boundary 



conditions in extra-dimensional models 36 
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Driving field 


Xf 


•yd 
-'2 




-'2 






•ydu 
-'2 




SU{5) 


1 


1 


1 


1 


1 


1 


1 


1 




1 


2 


3' 


2 


1 


V 


2 


1 


f/(l) 


-2z 


2y-2z 


-% 


-% 


X + 2y + 2; 


X — y + 2z 


2x — 2; 


2x 



Table 3: The driving fields required for obtaining the vacuum alignment. All these fields 
carry charge +2 under U{X)r. 



non-renormalisable terms we suppress the operators by appropriate powers of the generic 
messenger scale M. Note that in such a setup with no superpotential couplings of positive 
mass dimension it is impossible to exclude the trivial solution, i.e. a vacuum in which all 
flavon VEVs vanish. However, having chosen the specific set of U{\) charges x, y and z 
we comment on this issue in section 5.1 and present a way to enforce spontaneous family 
symmetry breaking in appendix D. 

The driving field Xf, coupled to $2 through 

xt{^if = xt<!>i,<^>i, , (4.1) 

allows to align ($2) either as 

($^) oc Q or as (j) . (4.2) 

In the following we choose the alignment in which the component $2 1 receives a non-zero 
VEV. Assuming Eq. (2.13) to hold, the alignment of the VEV of $2 is generated through 



an operator of the order A^. 

Using the field Y2 and the alignment achieved for ($2) we align the VEV of $3. In 
general we find three independent dimension-5 terms coming from y2'^($2)^('^'3)^/^^ 

^,{{<^ii? + 2<!>i,<!>isKy2'A^ii? + yi2iK2?) (4-3) 
+ ^2<iK2 Ki((<f 3,3)' + 2$ ii<f + yi2iK2f + 2$ii$i3)] 

+ ^2 Kl(*2,2)'((*3,2)' + 2$li$l3) + >^2';2(<^'2,l)'(('^3,3)' + '2<^iM,2)] , 

which yield the following conditions 

i^l.y + 2^1,^1, = and + 2^1,^1, = , (4.4) 



if the alignment of ($2) is plugged into the F-terms of Y21 and 1^2 2- ^'i- (4-4) shows that 
($3) has to be aligned as 

/0\ 1 / 2u;P \ 

($^) (X 111 or as - I -1 1 , p = 0,±l , (4.5) 
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with u = e^'^*/^. As before, we select the first of these four possible alignments. Assuming 
the relative size of the VEVs and (pf with respect to the messenger scale M as given 



in Eq. (2.13) we find that the operators responsible for the alignment of ($3) arise at the 
level A*'. 

The vacua of the fields $i,$2 ^^"^ ^3'^ whose alignments give rise to TB mixing in 
the neutrino sector, are driven by the fields Y2 and Zi^,. The part of the superpotential 
responsible for the correct alignment reads 

a'iY^^^'m + a'^Y^^mf + a'^Y^^i^,)' + b^Z^^.^l^l, + fc^Zg^,*^*^, + hlZ^,,{%,f (4.6) 

= [Y2M,2+ K2^h] + «2 [y2:im,i?+ y2:2m,2?] 

+ h\^l [^3^1*3M+ ^3',2<f3',3+ ^3',3'^'3',2] 

+ 6^ [^3%('^2,1<^'3',2+ <^'2,2<^'3',3) + ^3',2(<^'2,1<^'3M + '^'2,2<f 3',2) + ^3',3 ('^'2,l<f 3',3 + <^'2.2<f3M)] 
+ ^3 [^3m((<^'3m)'- <^'3',2<f3',3) + ^3',2((<^>3',2)' " <^>3M<^'3',3) + ^3'.3((<^'3',3)' " <^'3M*3',2) 



where the coefficients aj' and 6^ are undetermined complex parameters whose absolute 
values are of order one. The F-terms of the components of Y2 and Z^, vanish if the VEVs 
of $2 and $3, take the following forr^ 




{^l,) = , ($^) = 'J , (^r) = P = 0,±1 , (4.7) 



with the scales, ip^,, ip2, y^i, of the VEVs related through 

f 5 = - l^-vr . (v^r = (< - H ) -*(^r)' . (4. 



6650J V 26!; 

and remaining undetermined. Thus, without assuming any fine-tuning among the 
parameters aj' and 6^ in the superpotential the VEVs are expected to be of the same 
order of magnitude, 

^3^ ~ ~ . (4.9) 

This is a favourable situation as it ensures that all entries of the right-handed neutrino 
mass matrix are naturally of similar order of magnitude so that a non-hierarchical light 



neutrino mass spectrum is generated. In Eq. (2.21) the alignment with p = is given. 
Finally, we note that the alignment of the flavons relevant to the neutrino sector at LO 
arises at 0{X^). Thus, all combinations of fiavons coupling to the driving fields Y2 and 
Zy which might give a contribution to the alignment of order > A® have to be absent. 

Concerning the alignment of the VEV of $3 we notice that for this purpose two driving 
fields are required, X-^ and X'^f'. First, one aligns ($3) through the non-renormalisable 



^To be precise, we explicitly exclude solutions in which the fields $1 and $2 acquire a VEV whereas 



<i>3, does not. 



16 



operator 



M 



(4.10) 



X, + *3,2*3,1 + ^isKs) + <2{^i,lK3 + '^3,2<^'3,2 + <^'3,3'^'3,l) 



Using the alignment of ($2) ^"^^ {^3) &s discussed above we can immediately infer from 
setting the F-term of X-^ to zero that 



(4.11) 



so that only the second and third entry of ($1) can acquire a non-vanishing value. In 
order to correlate these entries we employ the field which couples $3 to $3, through 

X^!'^^, = Xr,'^($Ji<|.;^, 1 + ^J^'^'s'.s + ^3,3'^>3',2) • (4.12) 
For ($3/) being already aligned, the vanishing of the F-term of 

($3,1) + ($3,2) + ($3,3) = , (4.13) 
together with Eq. (4.11) shows that 2) ^^'^ ("^33) have to be equal up to a relative 



sign. Thus, ($3) is fully aligned as 



(4.14) 



Note that the operator from which ($f 1) = is inferred arises at order A® whereas the 
operator responsible for the equality of ($f n)and 3) is of order A'', using the orders 



of magnitude shown in Eq. (2.13) and Eq. (2.25). 



Finally, the vacua of the flavons, $2 responsible for giving masses to up quarks 

at LO, can be aligned with the help of two driving fields and X". The field Y-f"^ allows 
to couple the flavons $2 "^2 through the operator 



\^du^d^u _ ^^du^d , -i^du^d 

-'2 ^2^2 — -'^2,1^2,1^2,1 "T -'2,2^2,2^2,2 



(4.15) 



Thus, from the vanishing of the F-term of under the condition that ($2 1) 7^ holds, 
as discussed above, we immediately find that 



Similarly, the field X" couples the two fields $2 ^^'^ "^2 through 

^r(<^>2,l*2,2 + *2,2$2,l) • 
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(4.16) 



(4.17) 



Taking ($2) to be aligned as given in Eq. (4.16), we derive from the vanishing F-term of 



X" that ($2) is ahgned in the same way as ($2)' i-^- 



i^) oc (°) . (4.18) 



These ahgnments are induced by operators that arise - according to Eqs. ( 2.8[2.13 ) - at 
the order and A^, respectively. 

Since some of the equations leading to the alignment of the flavon VEVs do not have 
a unique solution, we arrive at a total 24 different degenerate vacua (not counting the 
ones in which ($3/) = 0). We note that these 24 sets are related by 5*4 transformations. 
Choosing one of the sets different from the one presented in Eqs ( pl6|2.10||2.2l"| clearly 



leads to fermion mass matrices which are of a different form from the one of those given 
in section 2. However, we have checked explicitly that all these sets of different fermion 
mass matrices are related to the one found in section 2 by 5*4 transformations performed 
on the matter superfields T3, T, F and A^. We emphasise that the results for fermion 
mixings are not changed by these transformations, because left-handed quarks as well as 
left-handed leptons transform in the same way. Thus, our choice of the vacuum structure 
is a convention that can be used without loss of generality. 

Similar to the fact that the F-terms of the driving fields are the origin of the alignment 
of the flavon VEVs, we can derive from the F-terms of the latter fields the vacuum 
structure of the driving fields. As all terms in the flavon superpotential are linear in the 
driving fields, the configuration in which all these fields have vanishing VEVs is in any case 
a solution. However, in our model we find that, plugging in the alignment of the flavon 
VEVs, this is not the only possible solution satisfying the requirement that all F-terms 
of the fiavons vanish. In principle, the two fields Xf and the second component of 
might have non-zero VEVs which fulfil a non-trivial relation. The absolute size of these 
VEVs is not determined, however their relative one. We note that non-vanishing VEVs 
for driving fields could induce a //-term for and which, in our model, is forbidden 
by the U{l)ii symmetry. In the following we will, however, assume that all VEVs of the 
driving fields are zero. 



4.2 Discussion of dangerous operators in the flavon superpoten- 
tial 

For specific choices of x, y and z additional operators which (can) spoil the above alignment 
might be allowed by the U{1) symmetry as well. Thus, it is necessary to check each of 
the 26 possible choices of U{1) charges x, y and z displayed in table [2] for such unwanted 
operators, using the vacuum alignments generated at the LO as shown in the preceding 
section. We classify all operators as unwanted which lead to contributions proportional 
to the same or to a lower power in A than the LO terms given above. 

As an example of an unsuccessful case which is excluded by our procedure, con- 
sider the U{1) charge assignment #1 with {x,y,z) = (1,2,5). In this case the operator 
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Zg/^f ($2)^/^ is allowed by all the symmetries of the model. Inserting the desired vacuum 



structure we arrive at a contribution of the form Z^, 2vt{'~P2Y 1^ being of order A^. This 



has to be compared to the terms given in Eq. (4.6) leading to the alignment of {^^21) 
which are of order A^. Thus, the additional operator Z^,(^i^{(^2Y / M gives a contribution 
dominating even the assumed LO one, so that the U{1) charge assignment #1 has to be 
discarded. 

Eventually, we are left with four potentially successful U{1) charge assignments (x, y, z) 
for which we do not find any operators that strongly perturb the LO alignment if the 
flavons assume their LO VEVs. These are 

#10: (4,5,2), #13: (5,4,1), #21 : (3, -2, 4) , #25 : (4, -1, 5) . (4.19) 

We note that two of the solutions, namely #10 and #21, allow for operators which could 
in principle strongly perturb the LO result, Y^^^^^-i X'^^^'^i^f)'^ / M and Y^i^i)^ /M, 
respectively. However, inserting the LO structure of the flavon VEVs we find that these 
operators give vanishing contributions. Nevertheless, they might still perturb the vacuum 
alignment if corrections to the LO vacua, caused by subleading terms, are taken into 
account (see below). In contrast to this, the solutions #13 and #25 do not allow for 
any operator which can strongly perturb the LO alignment, irrespective of the inserted 
vacua. Finally, we remark that for the choice #22 of f/(l) charges, {x,y,z) = (3,-2,5), 
there is one operator MvX^^'( which, depending on the size of the mass scale My, 
might or might not spoil the vacuum alignment achieved at LO. Choosing My < A^M 
renders the associated contribution subdominant compared to the one coming from the 



LO term, displayed in Eq.(4.10). However, since we would like to avoid the presence of 
such additional mass scales in the flavon superpotential at this stage of the study, we 
discard case #22. 

4.3 Correlations among the flavon VEVs 

Having obtained the structure of the vacuum alignment, we now turn to the question of 
relating the scales of the flavon VEVs. So far, the only such relation is the one between 



the three flavons, relevant for right-handed neutrino masses, as stated in Eq. (4.9). Such 
a correlation of scales of more flavon VEVs can be achieved by adding further driving 
fields. 

Referring to the detailed analysis in appendix D for the four viable choices of U{1) 
charges, #10, #13, #21 and #25, we find that only in case #13 is it possible to find 
two (independent) further relations among the flavon VEVs, if we introduce two further 
driving fields, transforming as singlets under 5*4. This result is achieved, if terms of 
a minimum size of order A^ are considered for scales of the flavon VEVs according to 
Eqs. ( 2.8[2.13[2.25 ), and the possibility of having couplings with positive mass dimension 



in the superpotential is not taken into account. 
Explicitly we find 



M^^.^cfi^i and MV2^^~<^M', (4-20) 
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which comprise together with Eq. (4.9) the maximum set of correlations that we can 



achieve in the context of our 26 possible U{1) charge sets, see table [2] As a consequence, 
the eight flavon VEV scales face four constraints, thus leaving four parameters undeter- 
mined. 

In the following we shall choose the flavon VEVs 

ifi, and (4.21) 

by hand to have the following orders 

^^/M~AS <^3/M~A^ ifi/M r-^ X and ip\/M ^ X'^ . (4.22) 

Then, using the above correlations, we can deduce without further assumption 

y?^/M~A\ ^^/M~A^ (^^/M~A^ and ~ A^ . (4.23) 

We find that the VEVs of the additional driving fields leading to the two further correla- 
tions have to vanish. This is required by the F-term equations of the flavons, if the LO 
alignments of Eqs. ( 2.6[2.10|2.21 ) are applied. As will be discussed in section 5.1 and in 
more detail in the second part of appendix D, the number of undetermined parameters 



among the flavon VEVs, see Eq. (4.21), can be further reduced if we allow for couplings 



with positive mass dimension in the flavon superpotential. 



5 A specific model at NLO 

Fixing the U{1) charges to take particular numerical values may allow certain operators 
that are forbidden for a general set [x, y, z) of U{1) charges so it is mandatory to study each 
model case by case. In this section we discuss the full results at NLO for the particularly 
promising model #13 where the U (1) charges are specified by (x, z) = (5, 4, 1). We note 
that we checked that the results of the study of the messenger sector, relevant in order to 
properly generate the two operators {F^)i{T^)iH^/M^ and {F^^^i)3{T^)3H^/M^ , 
are not altered by this choice of U{1) charges, especially no extra terms, not present in 
appendix B, arise (at the renormalisable level). 



5.1 Flavon superpotential 

We first summarise the operator structures arising at LO in the flavon superpotential 



20 



The effect of these operators has been discussed in detail in the preceding section and in 
appendix D. 

In addition, for case #13, we find several operators which are subleading in the expan- 
sion in A relative to these, when the orders of the flavon VEVs are chosen as in section 2 in 
order to reproduce in a satisfying way all fermion masses and mixings. These subleading 
operators in general perturb the result for the vacuum alignment at the LO in a particular 
way and thus affect the results for fermion masses and mixings. 

In the following we consider all subleading operators which can contribute at a level 
of up to and including order A^^, for scales of VEVs as shown in Eqs. (2.8|2.13|2.25). Due 



to the four undetermined and the four fixed VEV scales, see Eqs. ( 4.21|4.23 ), we have to 
parametrise the perturbed vacua of the fiavons in the following way 



.^2+^2.2 



^3,3. 



Vs' + A3', 

^3' + ^3', 
^3' + ^3', 3 



^2,1 
V2 

Ail 



V V's + Als I 



^2 + A^,i 

^2+A^o 



V2 



^2,2 



and (<I>^) = 



(5.2) 



Including all the above leading and subleading operators, we solve the equations orig- 
inating from the F-terms of the driving fields order by order in A, up to and including 
A^^ in order to determine the size of all the shifts A^^-, f = u,d, u. We find as result that 
the shifts are of the order in A 



/M = 6i,X' , AijM = M.X' 



AyM = 5y , AyM = 5y , (5.3) 



Ad 

^3,3 



AyM 



^3,3^' 

5y 



AyM 



53,2A' 



Aia/M 



^3,3^' 



AI,JM = 6^,, A' , A^,,JM = 6^y,X' , A^, 3/M = 6^,,,X' 



AyM = 6y and AyM = 6^ , 

where 6{j, f = u,d,h', are complex numbers with absolute value of order one, deter- 
mined by the couplings of the superpotential. Notice that the shifts associated with the 
components of the flavon $3, are equal at this level, i.e. 



^3'1 



^3' 2 



A" 



(5.4) 



so that the alignment, achieved at LO, is not perturbed up to the level A*^. Since we 
are not interested in the actual relation between ip'^, and (pi, we can absorb the shifts of 
the VEVs of the components of the field $3, into the LO VEV ipy. As we will see in 
section 5.2, this leads to the fact that tri-maximal mixing remains still preserved in the 
neutrino sector. 
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As one can see all ratios /^{-/ifl are small, at most of order A^, so that the shifts relative 
to the LO alignment are small. Nevertheless these might lead to relevant corrections to 
LO results for fermion masses and mixings, which is discussed in section 5.2. Using the 
parametrisation in Eq. (5.2) and the results of the shifts given in Eq. (5.3), the F-terms 
of all 15 driving fields vanish up to order A^^, apart from the one associated with the field 
which has a contribution at order A^^ which can only vanish if either one coupling of 
the fiavon superpotential is tuned to cancel the term or one of the involved flavon VEVs 
vanishes. This tuning can be understood because the F-term equations of the 15 driving 
fields have to be fulfilled by solving for the 14 shifts ^{j- However, since the required 
tuning arises only at order A^^ it has to be considered only a minor drawback in the 
construction of the flavon superpotential. 

Finally, we briefly comment on how to ensure the spontaneous breaking of the family 
symmetry (i.e. avoid the trivial solution with all fiavon VEVs being zero) by introducing a 
coupling with mass dimension two in the superpotential. This can be achieved by adding 
a driving field Vq ~ (1, 0) which is a total singlet under S'4 x U{1) so that the term My^Vo is 
allowed. At the same time, a combination of the undetermined VEVs, 1^25 V's' ¥^2 ipi, 
see Eq. (4.21 ), becomes fixed through Myp. Furthermore, we find that introducing another 
driving field V2 ~ (2, —8) gives rise to a term My2V2$2- Considering operators resulting 
in contributions of order A^ or larger, the field V2 leads to two additional constraints on 
the undetermined VEVs so that only one free parameter remains. See second part of 
appendix D for details. 

We remark that one could fix the remaining undetermined parameter among the flavon 
VEVs through a Fayet-Iliopoulos term of an appropriate size provided the U{1) symmetry 
is gauged. However, we do not pursue this possibility further. 



5.2 Fermion masses and mixings 

In the following we study the effects of the subleading operators. We include corrections 
caused by the shifted vacua as given above and the allowed multi-flavon insertions with 
up to eight flavons. 



5.2.1 Quark sector 

Including terms up to order A® we find that the up quark mass matrix remains nearly 
diagonal apart from the off-diagonal elements (23) and (32) which are of order A^. This 
correction originates from the operator structure TT^^^fj^^^fYH^/M^. The diagonal 
elements get corrected compared to the LO result: we find that the (11) element does not 
only arise from the LO operator TT^^^l^H^/M^ but also from the operator TT^^H^/M 
if the non-zero shift 1 is taken into account. However, we include the latter contribution 
into the former one. The (22) element receives a correction of order A^ stemming from the 
insertion of the shifted vacuum of $2 i^^o ^^e LO operator TT^^H^/M. All corrections 
which might arise to the (33) element can be absorbed into the coupling of the LO tree- 
level operator T^T^H^. After taking into account possible re-phasing of the right-handed 
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fermion fields we find that M„ can be parametrised as 




Mu= \ VcX^ I 2i"e-^""-iA6 z^e-'^-.^A^ | Vu ■ (5.5) 




Note that the parameters yu,c,t and real and positive and the phases au,i are 

between and 2n. Here and in the following we display each mass matrix as the sum of 
the LO and the NLO result. For the up quark masses we find 

m„ = y^X^u , = [yX + 0(A')) Vu , rut = [yt + 0(A^^)) . (5.6) 

Thus, all corrections coming from NLO terms are small. In particular, all mixing angles 
in the up quark sector are negligible. 

Similarly, we find the following parametrisation for the down quark mass matrix 

xaA^ -Jse^^'^-^A^ 

Md = I -xsA^ ?/se~*"'*-iA^ (-?/,e-^("''-i-"^'2)A^ + J2e^"''-2A^) | Vd (5.7) 
ybX^ 

zfe'^i,^X^ -zfe'^'^'^X^ 
+ ( zfe'^'i'^X^ -zfe'^^'^X^ 

zle'^d,3x6 z^e'^^^'^X^ 

where we have only displayed the first subleading contribution to each of the different 
matrix elements up to order A®. The parameters ys and yb are associated with the LO 
operators {F^f)i{T^2)iH^/M'^ and FT^^'^H^/M, respectively. X2 coincides with the 



LO parameter X2 as given in Eq. (2.4), up to corrections of order A^ which are due 
to the shift A3 3. The (11) element is of order A^ and originates from several possible 

contractions of the operator structures FT^l^^i^fH^/M^ and FT{^'^)'^{^j)^H4^/M^ . 
The (32) element arises at order A^ from the following two sources: through plugging 
the shifted vacuum of $3 in the LO operator FT^^'^H^/M and through the subleading 
operator FT3^2^fH^/M'^. Similarly, the (31) element of order A^ arises from the LO 
term FT^^fH-^/M and is proportional to the shift A|^. The corrections of order A^ in 
the (22) and the (23) elements, encoded in the parameters zf and zf, originate from the 
LO operator (F$3)i(T$2) 1-^^45/^^ if ^he shifts of the vacuum alignment are included, 
and are proportional to A3 3 and to A3 2, respectively. Finally, the correction to the 
(12) element is again the result of the shifted vacuum of $3, this time plugged into 
(F$2$2)3(^'^3)3-^5/^^ and is generically of order A'''. We note that also in case of 
Md (and Mg, see below) all parameters, yb,s, X2 and zf, are real and positive and that 
all appearing phases, ad^i and ipd^i-, are within the interval [0,2-7?). The mass matrix in 



Eq. (5.7) leads to down quark masses of the form 
rrid = (^^A^ + 0(A«)^ Vd , = [yX + 0{X^)) Vd , rrib = [yX + 0{X^)) Vd . (5. 



23 



For the quark mixing angles we find 



sin 91^ 



Vb 



Vs 



'-\ + 0{y) and tan^: 
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Vb 



(5.9) 



showing that the angles are only determined by the LO results and all subleading 
corrections are very small. The calculation of the Jarlskog invariant Jcp yields 



J, 



CP 



-%A^ina,,i + 0(A«) 



ysVb 



(5.10) 



which turns out to be slightly below its expected size of A^ (37|. Eqs. dS^SfS^ confirm 
the achievement of the GST relation 29 in our model, even after including corrections, 



tan ~ 



rrid 



(5.11) 



Due to the fact that only the parameters associated with the LO contributions are rele- 
vant for the determination of masses, mixing angles and CP violation, the model might 
turn out to be incapable of fitting the precise values for the quantities determined from 
However, we point out that in our model these quantities are evaluated 

which 



experiments 37 



38 



at a high energy scale and any renormalisation group and threshold effects 
among other things depend also on the actual value of tan/5, are not taken into account 
in this analysis. 



5.2.2 Lepton sector 

Coming to the lepton sector, we first note that the structure of the charged lepton mass 
matrix is analogous to the one of M^, apart from the GJ factor and the slightly different 
positions of the phases, after re-phasing of all right-handed fields. 



Me 



-XsA^ 

xsA^ -3?/,e-*"'*.iA^ 

-X2X^ (3|/,e-*"^'iA^ + J2A^) T/feA^ 

/ -3zfe^^<*'iAS 



Vd 



2|g«(ad,2+'/'d,3)_\6 



v 







^^d^-i{o'd,2-ipd,5) \G 



(5.12) 



Vd ■ 



The mass matrix given in Eq. (5.12) leads to charged lepton masses 



rrte 



X 



2 A^ + 0(A«) )vd, m^= (3y,A^ + ^(A^)) 



rrir 



{y,X^ + 0{X^)) Vd 



(5.13) 

which, similar to the quark masses, up to small corrections, are only determined by the 
LO terms. The GJ relations 30 are confirmed by Eqs. (5.8) and (5.13). The charged 
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lepton mixing angles are of the form 



sin^^3 = ^A^ + C(A^) , tan^^2 = :7^A + C(A^) , (5.14) 

lib •->ys 



tan 622, 



9(^1 _ g*{a:d,2+V'd,2) 

?/6/ Wh 



coinciding with the estimate found in section 2. 

The Dirac neutrino mass matrix elements also receive small corrections of order A^ 
and A^, respectively. They read 

/ Vd \ / 2^f A6 z^X^ A^ \ 

Md=\ yD]vu+\ z^X^ zfX" -^z^ - zf)X^ , (5.15) 

V / V -{z^ + z^)X' z^X^ I 

with yr) being the coupling accompanying the LO tree-level term FNH5. The corrections 
associated with the two parameters and Z2 originate from the operator structure 
FN^2Hb/M. The one associated with Z2 is additionally suppressed by a factor of A^ 
because it is not proportional to the VEV but rather to the shift A21. The source of 
the two corrections to the (11), (23) and (32) elements of order A^, encoded in and 
, is the operator structure FN{^'^'^^'^H^/M^. The two different parameters refer to 
two different possible contractions of the operator. 

In the right-handed neutrino mass matrix corrections are of a relative order A^. They 
are encoded in two parameters, denoted by Zi and Z2 in the following. The general form 
of Mji can be written as 

( A + 2C B-C B-C \ / Zi Z2\ 

Mr= B-C B + 2C A-C A^M+ Zi Z2 A^M. (5.16) 
\ B-C A-C B + 2C J \Z2 Zi/ 

In the above equation we have also introduced the parameters A, B and C, which (domi- 
nantly) originate from the LO terms aNN^'(, /3NN^!^, ^NN^'^,, respectively. Note that 
at the same time some of the subleading contributions are absorbed by re-defining A as 
well as C. The latter incorporates then also the contribution coming from the operator 
A^A^$2*^3,/M. One source of the contributions, parametrised by Zi and Z2, arc the shifts 
and A22 if the LO term NN^2 cvahiatcd with the shifted vacuum of $2- Apart 
from that, the subleading term NN (^2^2/^ contributes to the correction associated with 
Zi, while the two operator structures NN^\^'^/M and NN{^f)^/M'^ give a contribution 
to the (13) and (22) elements of Mr. The effective hght neutrino mass matrix which 
arises from the type I see-saw mechanism can be arranged as 

Bu Cy — Ajj Ay Ay \ / 9 

ml" =1 By cAi-^\ (5.17) 



Ay Cy Bi 



Zl Z2 

+ I zli z^ + zl 




X^M 



'4 



53 ^4 -t- Z2 ^4 
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Ai,, Bi, and C^j parametrise the LO contributions and the four independent parameters 
z'( the corrections to the hght neutrino mass matrix. In the following we will assume 
all these parameters to be real since there is no experimental evidence for CP violating 
phases in the lepton sector yet. As expected all corrections to the light neutrino masses 
arise at a relative level of A^. Due to the fact that, up to the order A®, the shifted vacuum 
of the flavon $3, reveals the same alignment as the LO one, the tri-maximally mixed state 
remains an eigenstate of the light neutrino mass matrix TrfJ^ (as well as of the right- 
handed neutrino mass matrix Mr). The neutrino mixing angles are thus still given by the 
TB mixing values up to corrections of (9(A^). Eventually, we find for the lepton mixing 
angles 



2x2 



Acosarf,i + 0(A2) , (5.18) 



sin^^' 



23 



36?/, 



A' + O(A^) , 



coinciding with the estimates given in Eq. (2.26). Comparing the results for quark and 



lepton mixing angles, Eqs. (5.9) and (5.18), we see that our model incorporates the cor- 
relations [31] 

1 2 

tan ^^^2 cos a^^i , (5.19) 



sin^ 



12 



9 



and 



sin ^ tan elJ{3V2) , (5.20) 
with ad,i playing the role of the Dirac CP phase 5' in the lepton sector, up to vr 



(5.21) 



This relation holds up to corrections of order A. Thus, we can write Eq. (5.19) also as 

'^[2 ~ ^ (1 + 2^2 sin ^[3 cos 5 



sm 



(5.22) 



Note that Eq. (5.22) holds without loss of generality, although we have assumed all pa- 



rameters in the neutrino sector to be real since, as shown in [31], the validity of this 
relation only depends on the fact that Of^, 623 and are (much) smaller than 6'^2- 



It is convenient to define 39 



sin ^5 



sin 6^1 



1 



1 



13 — ^^^^'^12 — ;^vl + -s); sin6'23 — -^i 



1 + a). 



(5.23) 



where we have introduced the three real parameters r, s, a to describe the deviations of the 
reactor, solar and atmospheric mixing angles from their TB values. The present model 
predicts these deviation parameters to be. 



s^rcos6^, r ^ A/3, a^-A^/36. 



(5.24) 
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up to renormalisation group effects and corrections associated with non-canonically nor- 
malised kinetic terms. While the first equation above is the usual sum rule in terms of 



deviation parameters 39 , we emphasise that the model predicts another new relation 

a ^ -rV4, (5.25) 

with r ^ A/3, valid at the GUT scale. 

In summary, all NLO corrections turn out to have a negligible effect on the results for 
fermion masses and mixings achieved at LO and presented in section 2. 



6 Conclusions 

In this article we have constructed a model of fermion masses and mixings based on the 
combination of the minimal GUT SU{5) and the family symmetry 5*4. The latter is also 
minimal in the sense that it is the smallest non-Abelian finite group which contains all the 
symmetries necessary to enforce TB neutrino mixing. At LO, the effective light neutrino 
mass matrix arises from the type I see-saw mechanism where the TB mixing structure is 
imprinted in the form of the Majorana mass matrix of the right-handed neutrinos. The 
latter in turn originates from the vacuum alignment of three different flavon fields $3,, 

As the right-handed neutrino mass matrix contains three independent parameters, 
our model can accommodate all patterns for the neutrino masses; in particular we do not 
encounter the constraint of a neutrino mass sum rule as in the corresponding A4 models. 
At the same time the TB neutrino mixing is independent of the particular values of the 
neutrino masses and also stable under inclusion of NLO corrections. Taking into account 
the corrections to the fiavon alignments as well as higher-dimensional operators, we find 
that TB neutrino mixing remains exact up to (9(A^) ~ 0.1% at the GUT scale. 

Regarding the masses of the charged fermions, we invoke additional SU{5) singlet 
fiavon fields. Their LO alignments give rise to acceptable quark and charged lepton 
mass matrices, including the phenomenologically successful GJ and GST relations. The 
latter cannot be achieved in a generic effective theory, but require some specific set of 
messenger fields. Such a set has been explicitly constructed. Having introduced eight 
fiavon fields, it is necessary to study all allowed superpotential operators with two matter 
fields and an arbitrary number of fiavons. In order to forbid those terms which would spoil 
the LO results for the mass matrices, we introduce a new U{1) symmetry, parametrised 
by three integers {x,y,z). Their specific values are determined when discussing how 
to obtain the required vacuum alignment. In our model this originates from the F- 
terms of an additional set of fields, the driving fields, which cannot couple directly to the 
matter superfields. Solving the F-term equations of the driving fields in the SUSY limit, 
we can obtain the desired flavon alignments at LO. Additional driving flelds are then 
added to obtain further correlations between the scales of the flavon VEVs. This study 
flxes our preferred choice of U{1) charges, given by {x,y,z) = (5,4,1). The number of 
undetermined parameters among the flavon VEVs can be minimised by considering driving 
fields allowing for couplings with positive mass dimension in the flavon superpotential. In 
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this way we can obtain by the (ad hoc) choice of the magnitude of two mass parameters 
and one flavon VEV, which remains undetermined, the correct size of the VEVs of all 
flavons coupling to the supcrficlds T3, T, F and A^, as required to achieve the observed 
fermion mass and mixing patterns in the quark and lepton sector. In the final part of this 
work we have scrutinised the NLO effects on the flavon alignments as well as the fermion 
mass matrices. Our results reveal that the NLO corrections have a neghgible effect on 
quark and lepton masses and mixings, thus confirming the stability of the original LO 
structure of the model. Since the main purpose of this work is the study of fermion 
masses and mixings, we have not discussed the GUT Higgs sector and the corresponding 
(super-)potential necessary in order to correctly break SU{5) to the SM gauge group. 

In conclusion we have constructed a SUSY GUT of Flavour based on 5*4 x SU{5), 
together with an additional (global or local) Abelian symmetry, and studied it to NLO 
accuracy. We have specified the complete effective theory for general U{1) charges, valid 
just below the GUT scale, relevant for fermion masses and mixings, and performed a 
full operator analysis taking into account all relevant higher order terms with several 
insertions of flavons. The model includes a successful description of quark masses and 
mixing angles at LO incorporating the GST relation. In addition, at LO, charged lepton 
and down quark masses fulfil GJ relations. Our predictions apply just below the GUT 
scale, and the determination of the fermion masses and mixings at the electroweak scale 
would require a detailed investigation of renormalisation group and threshold effects which 
is beyond the scope of this paper. We have studied the vacuum alignment arising from 
F-tcrms to NLO and the resulting corrections have been shown to not affect the LO 
predictions significantly for specific choices of U{1) charges. A specific model evaluated 
to NLO predicts TB mixing in the neutrino sector very accurately up to corrections of 
order 0.1%. Including charged lepton mixing corrections leads to small deviations from 
TB lepton mixing described by a precise sum rule, with accurately maximal atmospheric 
mixing and a reactor mixing angle close to three degrees. 
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Appendix 



A Group theory of ^'4 

The group is the permutation group of four distinct objects and is isomorphic to the 
symmetry group O of a regular octahedron. Its order is 24 and it contains five real 
irreducible representations: 1, 1', 2, 3 and 3'. Only the two triplet representations are 
faithful. A decisive feature among the two triplets 3 and 3' is that only 3 can be identified 
with the fundamental representation of the continuous groups 5*0(3) and SU{3). The 
three generators S, T and U are of the following form for the five different representations 

1:5 = 1, T = l, U = 

1' : S = 1 , T = l, U = 

/-I 2 2\ / 1 \ 

3: S=h i 2 -1 2 \ ,T=\Oco^O\,U = 






3' : S=k \ 2 -1 2 \ , T = \ to' \ , U 



with uj = e^'^*/^. 

The generators fulfil the relations 

52 = 1 , = 1 , f/2 = 1 , 

{STf = 1 , {SUf = 1 , {TUf = 1 , {STUy = 1 . 

Note that the minimal number of generators necessary to define S4 is actually only two, 
compare e.g. [16j. However, in order to emphasise the correlation between the groups 
and 5*4 it is advantageous to choose the set 5", T and U, since then one easily sees that 
S and T alone generate the group A4, see fifth reference in [6]. Notice that similarly, the 
two generators T and U alone generate the group 5*3 fio]. The character table is given in 
table |4j The Kronecker products are of the form 



1 X n = ^ y H , 1' xl' = 1 , 1' x2 = 2 
1' X 3 = 3' , 1' X 3' = 3 , 
2x2 = 1 + 1' + 2, 2x3 = 2x3' = 3 + 3', 
3x3 = 3' X 3' = 1 + 2 + 3 + 3', 3x3' = l' + 2 + 3 + 3'. 

In the following we list the Clebsch-Gordan coefficients using the notation a ~ 1, a' ~ 1' 
{bu h2)\ (hi, 62)* ~ 2, (ci, C2, C3)*, (£1, 52, £3)* ~ 3, (c'l, 4, c'3)*, (c'l, c'2, c^,)* ~ 3'. 
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Classes 








C3 


C4 




G 


1 


c 


U 


1 


01 u 


Tli 


1 


3 


6 


8 


6 


hi 


1 


2 


2 


3 


4 


1 


1 


1 


1 


1 


1 


V 


1 


1 


-1 


1 


-1 


2 


2 


2 





-1 





3 


3 


-1 


-1 





1 


3' 


3 


-1 


1 





-1 



Table 4: Character table of the group S4. Ci denote the five classes of S4, rii the number 
of distinct elements in the classes Ci and hi the order of the elements contained in class Ci. 
For each of the classes we give a representative G in terms of the generators S, T and U. 

For a singlet multiplied with a doublet or a triplet 

1^') X 2 : {abi, abiY ~ 2 , (a'bi, -a 62)* ~ 2 , 

1^'^ X 3 : (aci, ac2, acsf ~ 3 , {a'ci, a'c2, a'csf ~ 3' , 

iW X 3' : {ac[, ac'^, ac'^f ~ 3' , {a'c[, a'c'^, a'c'^f ~ 3 . 

For a doublet coupled to a doublet 

2x2: 6162 + &2&1 ~ 1 , bj)2 - 62^1 ~ 1' , (fe2&2, bibiY ~ 2 . 

For a doublet multiplied with a triplet 

2x3: (61C2+62C3, &1C3+62C1, 61C1+62C2)* ~ 3 , (61C2-62C3, &1C3-62C1, &1C1-62C2)* ~ 3' , 
and 

2x3': (614-62C3, 6i4-62ci, bic[-b2c'^Y ~ 3 , (614+624, bic'^+b2c[, 614+624)* ~ 3' . 

For the product 3x3 

CiCi + C2C3 + C3C2 ~ 1 , (C1C3 + C2C2 + C3C1, C1C2 + C2C1 + C3C3)* ~ 2 , 
(C2C3 - C3C2, C1C2 - C2C1, C3C1 - C1C3)* ~ 3 , 

(2ciCi - C2C3 - C3C2, 2C3C3 - C1C2 - C2C1, 2C2C2 - C1C3 - C3C1)* ~ 3' , 
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as well as for the product 3' x 3' 

Ciq + C2C3 + C3C2 ~ 1 , (c^Cg + C2C2 + C3C1, C1C2 + C2q + C3C3) ~ 2 , 

(2C]^C]^ — C2C3 — C3C2, 2C3C3 — C]^C2 — C2C]^, 2C2C2 — C]^C3 — C^^]) ~ 3 , 

and finally for the product 3x3' 

Ci4 + C2C3 + C3C2 ~ 1' , (C1C3 + C2C2 + C3C1, -(C1C2 + + C3C3))* ~ 2 
(2ci4 ~ C2C3 — C3C2, 2C3C3 — C1C2 — C24, 2C2C2 — C1C3 — csq)* ~ 3 , 
(C2C3 - C3C2, C1C2 - C2C1, C34 - C1C3)* ~ 3' . 



These results are in accordance with 16 



Note that due to the choice of T being complex for the real representations 2, 3 and 
3' for fields which transform as (0i,02)* ~ 2, ^"25 V's)* ~ 3 and {ip[,'ip2,ip'3y ~ 3' 
their conjugates, (0^,02)*; (V"!; "^25 ^3)* ((V'l)*; (V'2)*5 (V'3)*)* are in 2*, 3* and (3')*, 
respectively, and only (0$, 0^)* ~ 2, {ip^, ip^, ip^f ~ 3 and (^/'g)*, (^2)*)* ~ 3' holds. 

Eventually, we display the embedding of S'4 into the continuous groups SO (3) and SU{3) 
as well as its breaking to the discrete groups ^4 and 5*3 jil] . The smallest representations 
of 5*0(3) and SU{3) are decomposed into S'4 representations, respectively 



S0{3) S4 

1 ^ 1 

3 ^3 

5 ^2 + 3' 

7 -> 1' + 3 + 3' 

9 ^ 1 + 2 + 3 + 3' 



5t/(3) 




5*4 




1 


— > 


1 




3 


— ^ 


3 




6 


— > 


1 + 24 


3' 


8 


— > 


2 + 34 


3' 


10 




l' + 3- 


f 3 + 3' 



The decomposition of the irreducible representations of S'4 into those of the groups ^4 
and S3 leads to 



Sk 




A4 




— > 




1 




1 


1 


-> 


1 


1' 




1 


r 


-> 


1' 


2 




1' + 1" 


2 


-> 


2 


3 




3 


3 


— > 


1' + 2 


3' 


— 


3 


3' 


-> 


1 + 2 



Note that due to the choice of S, T and U the decomposition of S'4 representations into 
those of A4 and S3 can be nicely read off from the generators. 



31 



Particle 


s 




A 




T 






1]^ 





QC 


SU{5) 


To 


10 


5 


5 


5 


5 


5 


5 


5 


5 




1 


1 


1 


1 


2 


2 


3 


3 


3 


3 


m 


—X — z 


X + z 


X + 2z 


—X — 2z 


X 


— x 


y + 2z 


-y - 2z 


y + z 


-y - ^ 


U{1) 


-6 


6 


7 


-7 


5 


-5 


6 


-6 


5 


-5 



Table 5: Heavy fields necessary to generate the diagrams given in figure [T} We list their 
U (1) charges in terms of the parameters {x, y, z) as well as for the specific case #13 where 
{x,y,z) = (5,4, 1), as chosen in section 4.3. All fields carry a f/(l)_R charge +1. 



B Messenger sector 

As already discussed in section 2, in order to generate the operators (F$3)i(T$2) 1-^^45/^^ 
and {F^m)3{T^i)3H^/M^ we have to require a specific choice of mediators to exist in 
a high energy completion of our effective theory. This is necessary in order to correctly 
achieve the GJ relations among the down quark and charged lepton masses as well as in 
order to ensure the validity of the GST relation. To this end, we add five pairs of heavy 
fields {S, S^}, {A, A'^}, {T, T^}, {n, n^} and {9, 9^} which are vector-like under SU{5) x 
U{1). Apart from the pair {E, E'^} all fields transform as 5-plets under SU{5). Similarly to 
the supermultiplets containing the SM particles, they carry a charge +1 under the U{1)r 
symmetry. Their transformation properties under the family symmetry 6*4 x U{1) as well 
as under the SU{5) gauge group can be found in table |5} The U{1) charges are given 
in terms of the general parameters (x, y, z) as well as for the specific case #13 where 
{x,y,z) = (5,4,1), as chosen in section 4.3. The relevant terms in the superpotential 
which give rise to the first diagram of figure [l| and thus to (-F$3)i(T$2) 1-^^45/^^? 

w^heavy D a^T^^E + a2H^A'J:' + a3AF^ (B.l) 
+MeE"E + MaA'^A . 

The second diagram of figure [l| corresponding to the operator (F$2'^2)3(^'^3)3-^5/^^! 
is generated from the terms 

«^heavy D f3,TT'' + P^Tmi + ^^Q'^Q^^ + /S^FO'^^i (B.2) 
+MxT^T + Mnn^n + MeQ^Q . 

Note that we omit SU (5) indices throughout this calculation. According to |42] we can 
integrate out the heavy degrees of freedom {E, E"^}, {A, A"^}, {T, T'^}, {Q, Q'^} and {9, 9^^} 
by computing the derivatives of Wheavy with respect to these fields, setting them to zero 
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and plugging the result for the heavy fields back into the superpotential Wheavy as well as 
the Kahler potential. The Kahler potential for the heavy fields is canonical in the lowest 
order in the expansion of fiavon fields. We find for the derivatives of ifheavy 



— — — = MaA + a3(i^i5>3 ^ + i'25'3_3 + i^3*3,2)) "^^^2 

= MrTl + /32(J7i$f 3 + n,^ , + f]3$f i), %^ = ^ee^ + M^l'^li + ^'2,2), 

O ±2 ' ' ' u^2 



-2 



(B.3) 



Plugging the solution for the heavy fields back into Wheavy and using the vacuum 
structure of $2 and $3, as shown in Eq. (2.10), we arrive at 

-iF2T2-F,T2)H^cpiipi, (B.4) 



|M^(-F2T, + F,T2 + F3T, - F,n)H,^i^i^i , (B.5) 

which shows that terms of exactly the required form are generated and no further ones, 
compare to Eqs. ( |23|2.4[2.11pl2l ). 

There are additional terms ^ which also arise at the renormalisable level involving the 
messengers 

7i$^TT^ + 72$^fin" + 73$^ee'= . (B.6) 

These terms are expected to give small corrections to the LO mass terms of the messengers 
which are Mr, Mq and Mq. The terms involving $2 should be small compared to 



^'^One can easily check that this set of additional renormalisable operators is exhaustive even if we 
consider the specific C/(l) charges of case #13, see table [5] 
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those, since ($^) ^ with M being the generic messenger mass. These terms can 

also be taken into account when integrating out the heavy fields and give a subleading 
contribution to the fermion mass matrices which is suppressed by compared to the 
LO one. The fiavour structure deviates from the one of the LO term. However, all such 
corrections have a small effect on the mass spectrum of the fermions and their mixings. 
Plugging the solution for the heavy fields into their Kahler potential shows that the non- 
canonical terms generated for the supermultiplets containing SM fermions are small and 
thus do not considerably affect our assumption of a canonical Kahler potential for all 
fields. 



C List of unwanted terms with up to three flavons 

Here we present all operators with up to three fiavons which are classified either as dan- 
gerous or as marginal. As done in section 3 we only consider the case oi k = 1. Apart 
from the operator we show in this table also the A-suppression of the contribution(s) due 
to this operator as well as the entries of the mass matrices which are in confiict with 
the LO setup. Entries for which the operator is marginal in the above sense are marked 
with square brackets, whereas for all other ones the operator is dangerous. Note that we 
only give one of the two entries [ij) and {ji) in the case of symmetric or symmetrised 
terms, TTH^, T^TH^, NN. The three operators denoted with a prime (43', 48', 54') 



differ from the LO terms of the down quark sector in Eq. (2.2) only by the exchange of 
H-^ and H^. All other terms given for the down quark sector must be forbidden for both 
Higgs fields, as well as H^. Note that in this calculation we assumed the vacuum 



alignment of the fiavons as given in Eqs. ( 2.6[2.10|2.21 ), apart from the fact that we allow 



($3) to be aligned as (0, k, 1)* with \k\ = 1, k complex, instead of using (0,-1,1)* as 
shown in Eq. ( 2.10[ ). Albeit these alignments lead to the same LO results for fermion 



masses and mixings, the results for the classification of dangerous and marginal operators 
are slightly different: the operator ^^18 which is dangerous becomes irrelevant for the 
specific alignment ($3) oc (0, —1, 1)* as does the marginal operator #32. Note that, for 
notational simplicity, the appropriate powers of the messenger scale M, necessary to give 
the correct mass dimension of the operators, are omitted in the following table. For the 
operator FTH-^^^^/M (il) indicates that the contributions to the (11), (21) as well as 
(31) elements are classified as dangerous. 



^^Note that in the discussion of the flavon superpotential in section 4 we present a setup of driving 
fields which only leads to the alignment cx (0, —1, 1)*. 
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D Relations of flavon VEVs 



D.l Correlations among flavon VEVs 

In this part of appendix D we detail the calculations which lead to the results given in 
section 4.3. If we want to couple additional driving fields, not already present in table 3, 
to the flavons, in order to correlate the flavon VEVs further such fields obviously have to 
couple to at least two operator structures with different flavon content. For this to work, 
the latter operators have to: {i) have identical U{1) charges, (ii) transform identically 
under 5*4 and (Hi) obviously have the same overall A-suppression if we insert the assumed 



suppression of the occurring flavon scales as given in Eqs. ( 2.8[2.13[2.25 ). Furthermore, as 
already mentioned at length above, we avoid introducing new mass scales into the flavon 
superpotential at this stage (with the exception of case #10, see below and table 6). 

In the case that the additional driving field furnishes a doublet or a triplet represen- 
tation of 5*4, we have to ensure that the F-terms of all the components vanish for the 
LO vacuum structure of the flavons. The following example illustrates this issue: let us 
consider the U (1) charge assignment #10 and a driving field Zg'^™ being a triplet 3 under 
5*4. For Zg^™ having the U{1) charge +13 we find two flavon combinations $2*^^ and 
($3)^$2/^^ which can couple to Z^^"" in order to form an invariant under 5*4 x U{1). 
Furthermore, these combinations revea! 



the vacuum alignment of Eqs. (2.6 



2.10 



the same A-suppression (A ). However, inserting 



2.21), we find that for ($2'^§) the first as well as 



the third component of the triplet 3 are non-zero, whereas only the third component of 
3 is non-zero for {{^fY^'^/^'^)- Thus, we cannot satisfy the requirement of vanishing 



F-terms for all components of Zg*^™ unless we set some of the flavon VEVs to zero, This 
discussion shows that the constraint of the vanishing of the F-terms of all components 
considerably reduces the possibilities of introducing additional driving fields, which give 
rise to correlations between the scales of flavon VEVs. Moreover, also for any new driving 
field which couples consistently to at least two terms with identical A-suppression, we 
have to check that the same driving field does not couple to other terms which are less 
suppressed and thus would strongly perturb the desired correlation. 

Restricting ourselves, for practical purposes, to operators whose order in A is < A^ 
if the scales of the flavons according to Eqs. ( 2.8[2.13[2.25 ) are plugged in, the number 



of possible new driving fields which correlate the different scales ip2, '^2-> vii ^ti V^i 
ip'^ narrows down to only a few. In particular, for our four U{1) symmetries we find 
the correlations in table [6j A few aspects are interesting to observe: first of all, notice 
that for solution #10 the additional driving field(s) has (have) to be neutral under the 
U{1) symmetry. For this reason a coupling with mass dimension two is allowed, if the 
field X"*^™ is used. Furthermore, we find only a limited number of possible correlations 
among the VEVs. Especially for a given choice of U{1) charges x, y and z we find at 



^^Moreover, a detailed analysis shows that there exist two operators, Mz^<='^ Z^°'"^^, with Mzno-^ ~ 
X^M M being an explicit mass scale, and Z3™<i>3$2) arising respectively at A'^"'"^** and A^, that also give 
non- vanishing contributions if the flavon vacuum structure at LO is employed. These contributions would 
perturb any possible correlation among the VEVs > fi^ft and ^3. 
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f/(l) symmetry 


#10 


#13 


#21 


#25 


Driving field 


^lorl' 


^ncw 


"V^ncw 
^lorl' 


^lorl' 


x^ncw ynew 
^lorl' ^3or3' 


"^lorl' 


^lorl' 


C/(l) charge 





15 


18 


25 


10 


6 


20 


Order in A 


A8 


A9 


A^ 


A9 


A^ 


AS 


A9 


Correlation 


C#io 


C#i3 


'-'#13 


C#21 


C#25 



Table 6: The driving fields and the resulting correlations for the four successful charge 
assignments. The correlations follows, C#io : M2((^f)Vr ~ (</^^)V2[ + ^i-w^']; 

C#25 : Mv9^ ~ (fi^ipf. Note that for case #10 additionally an explicit mass term for the 
field Xf^"^ is allowed as it is a (trivial) singlet under 5*4 and uncharged with respect to 
the U{1) symmetry. The size of M^n™ has to be chosen as A^M. 

most two distinct relations among the VEVs. In the case in which a certain relation 
can be reproduced through several different driving fields, e.g. in the case #21 in which 
M'^ip2^i ~ (¥^2)^(^3)^ can be achieved through four different driving fields, -^"o7i' or 
^3o73'' obviously only one of these can be added to the model because otherwise we 
would have to require ad hoc relations among the parameters in the superpotential to 
reconcile the results. For a similar reason it is also not possible to introduce a driving 
field in the case of solution #21 instead of Xf-^^, or Z^'-^^,. Thirdly, notice that 

only for the U{1) charge assignment #13 we find two distinct additional relations among 
the scales of the fiavon VEVs. One might argue that we can also achieve two non-trivial 
relations if, in the case #10, we make use of both fields, Xf^"" and X^p"". (This is possible 
since the consequential conditions for the fiavon VEVs differ by the term related to the 
mass scale M|-now.) However, as stated in section 4.1 we avoid the introduction of such 
terms into the fiavon superpotential at this stage. Therefore we focus on scenario #13 in 
the phenomenological analysis presented in section 5. 

From table [6] we see that scenario #13 can lead to the relation 

through a new driving field transforming as 1 or 1' under S4 carrying either charge +18 
or charge +25 under the U{1). Since the relation arises at order A^ in the former case 
we will include - without loss of generality - the 5*4 singlet driving field X"''™ with charge 
+18 in our model. Additionally, we add the field Xj^f^ with U{1) charge +15 giving rise 
to the correlation 

MV2^3 ~ Vii^t)' ■ (D-2) 
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The additional terms in the superpotential read 

+ [(*2,1*3,2 - *2,2*3,3)((*3,l)' " *3,2*3,3) 

+ (*2,1*3,3 - *2,2*3,l)((*3,2)' ' $3,1*3,3) + (*2,1*3,1 " $2,2*3,2) ((*3,3)' " *3,1*3,2)^ 

and 

^ $2 *3*3 + ^ *^(*^)' (D.4) 

= ^ + *3,2*3,1 + $3,3*3,3) - *2,2(*3,1*3,3 + *3,2*3,2 + *3,3*3,1 

„new ^ 

+ ^ ((*3.l)' + 2*12*3,3) [*2,l((*3,3)' + 2*li*l2) - *2,2((*3,2)' + '^^tMs 

^new ^ 

+ [*ll((*l2)' + 2$ li^ls)' - *2,2((*3,3)' + 2$li«I>l2)'] • 

Finally, one can check that the VEVs of the driving fields X^^"" and X'^p^, which are 
determined by the F-term equations of the fiavons, vanish if the LO alignments of 
Eqs. ( |2^2.10|2.21D are applied. 



D.2 Mass scales in the flavon superpotential 

Here we introduce further driving fields which allow for additional mass scales in the 
flavon superpotential. Thus the trivial vacuum in which all flavon VEVs vanish can be 
destabilised. In addition, the number of free parameters among the undetermined VEVs, 
ip2, V^i, 9^25 ^^"^ V'l' can be reduced to a minimum of only one parameter. We consider 
only the speciflc case #13 which we have singled out in section 4.3 and in the flrst part 
of this appendix. 

Invoking a driving fleld Vq which is neutral under the family symmetry 6*4 x f/(l) 
allows for the following couplings up to order (if we already take into account the 
phenomenologically determined sizes of the different flavon VEVs) 

K,M4 + Voi^Y + Vo{<l>if M + K)(*3)'*2/M + Vo{<^tf^,/M . (D.l) 

Studying the equation derived from the F-term of Vq and using the LO form of the flavon 
VEVs, we flnd the relation 

Mi + {^irV2/M + i^trVy/M = . (D.2) 

As the VEVs and (p'^, are already related to through the F-terms of the driving 
flelds Z3, and Y2, see Eq. (4.9), we flnd that y^f can be expressed through My^ and 
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In order to achieve the correct order of magnitude of the VEV y^f we demand that 



~ A^M. More importantly, in order to fulfil Eq. (D.2) the flavon VEVs (p^ and ipf 



must be non-zero. This excludes the trivial solution with only vanishing VEVs which 
cannot be avoided if only the driving fields listed in the main text are present. Therefore 
Vq ensures that the family symmetry actually gets broken. 

In a similar way we can introduce a field V2 ~ (2, —8) which allows, up to the order 
A^, for the following couplings 

From the F-terms of the two components of V2, V2,i and V2,2, we find the relations 

Mv,^2 + ^2^1 + iviT/M' = , (D.4) 
My,</^^ + &^ = 0, (D.5) 

if we apply the LO results for the flavon VEVs. As one can see, we can relate the VEV (f2 
to the mass scale My^. In order to end up with the correct order of magnitude for if 2, we 



have to set My^ ~ A^M. Using ~ fi, Eq. (D.4) additionally leads to a determination 
of ip2 in terms of and My^ and consistently leads to (p2 ~ XM. Notice further that 
the inclusion of the driving field V2 is essential for giving non-zero VEVs to all flavon 
fields. (Here we are still assuming that a solution with ($3/) 7^ is chosen, as shown in 



In summary, by adding the two further driving fields Vq and V2 we can enforce the 
breaking of the family symmetry, eliminate three of the four undetermined parameters 
among the flavon VEVs and ensure that all these VEVs have to be non-vanishing. The 
explicit mass scales, My^ and My^, as well as the free parameter ip^ all have to be of the 
order of A^M in order to generate the sizes of the flavon VEVs as invoked in the discussion 
of fermion masses and mixings in section 2. Obviously, we have to choose these values by 
hand. In order to fully include these fields into the model presented in section 5, a careful 
study of the subleading corrections arising from higher-dimensional operators as well as 
a re-calculation of the shifts in the flavon VEVs would have to be performed. 

We have also studied the effect of other possible driving fields V allowing for terms of 
the form MyV^ with $ being a flavon. However, several of these [i) cannot be consistently 
introduced, (ii) lead to some parameter fine-tuning if considered in a setup together with 
Vo or (Hi) lead to redundant results only. Therefore we conclude that the presented choice 
of fields, Vo and V2, is the most favourable one. 

Obviously, such fields could also be considered for the choices of f/(l) charges which we 



have discarded in section 4, see Eq. (4.19). We have checked that a consistent introduction 
of such fields is generally possible, however, it does not lead to a scenario with less 
parameters than the one presented in the paper. 
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